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Abstract 

This  study  is  i->elated  to  optimum  control  strategies  used  by  a  manager 
supervising  a  group  of  independent  activities  v;hose  performances  deteriorate 
with  tiiT.e.   At  the  end  of  a  da}',  the  manager  evaluates  information 
regarding  the  performance  levels  of  the  activities  during  that  day  and 
decides  v;hich  activity  to  attend  to,  since  he  can  control  only  one  at  a 
time.   The  deterioration  of  performance  and  the  improvem.ent  of  the 
deteriorated  performance  by  a  control  action  from  one  level  to  othei-' 
levels  are  given  by  stationary  transition  probabilities.   Optimal  strategies 
for  this  control  are  obtained  by  the  linear  programming  method  proposed 
by  Manne  [ 7 ] . 


3U.&G1<ir    RX.    bi? 


I .   Introduction 

The  present  paper  studies  a  case  where  a  manager  controls  a  group  of 
independent  activities  whose  performances  deterioi^ate  v.'ith  time.   This 
management  contx^ol  is  presumed  to  be  an  iterative  process  composed  of 
three  steps:   (1)  the  observation  of  the  conditions  of  activities,  (2) 
the  selection  of  an  optimal  course  of  action,  and  (3)  the  execution  of 
this  course  of  action. 

Each  of  the  activities  may  be  considei^ed  as  a  man,  a  machine,  or  a 
man-machine  system  and  is  engaged  in  production  of  goods  or  services 
independent  of  the  other  activities.   It  consumes  direct  labor  and 
materials  at  constant  rates.   Its  performance  is  measured  by  the  net 
utility  produced  dux^'ing  the  day  and  represented  by  one  of  a  finite 
number  of  "performance  levels"  or  merely  "levels".   The  performance  of 
each  activity  tends  to  deteriorate  v;ith  time;  the  transition  of  the 
activity  from  a  level  in  the  previous  day  to  various  othei-'  levels  in 
the  follov.'ing  day  is  given  by  a  set  of  stationary  probabilities.   The 
stationary  transition  pi^obabilities  mean  that  the  basic  characteristics 
of  the  activity  do  not  change  in  time. 

The  manager  is  responsible  for  maintaining  the  performance  of  each 
activity  at  a  high  level  by  executing  proper  control  actions  for  the 
activity  whenever  necessary.   At  the  end  of  a  day  he  evaluates  the 
performance  of  each  activity  during  that  day  and  determines  whether  a 
control  action  is  necessary  to  improve  the  deteriorated  performance. 
The  execution  of  the  control  action  is  carried  out  in  tv;o  steps;   First, 
the  manager  examines  the  conditions  of  the  activity's  essential  factors 


attributable  to  the  existing  perfoi^mance  level.   Then,  on  the  basis  of 
this  examination,  he  selects  and  applies  a  conti^ol  action  to  the  activity. 
The  length  of  time  required  to  complete  the  conti^ol  action  depends  on  the 
activity'  and  its  current  performance  level.   Although  his  control  action 
aims  at  the  best  result  possible  for  the  existing  level,  it  does  not 
necessarily  achieve  this  result,  owing  mainly  to  inaccuracy  in  his  exam- 
ination of  the  conditions  and  execution  of  corrective  measures.   Therefore, 
the  result  of  a  control  action  depends  on  the  existing  per-formance  level 
of  the  activity'  and  is  given  not  by  a  single  impi'oved  level  but  by  a  set 
of  levels  with  a  probability  distribution,  essentially  reflecting  the  skill 
of  the  manager.   This  probability  disti^ibution  is  assumed  stationary, 
which  means  the  skill  of  the  manager  neither  improves  nor  erodes  with  time. 

One  important  restriction  imposed  on  the  manager  is  that  he  can 
attend  to  only  one  activity  for  control  at  one  time.   Under  this  restriction, 
he  gives  attention  simultaneously  to  all  the  activities  and  determines 
not  just  v.'hether  these  activities  need  control  actions  but  also,  should 
more  than  one  of  them  need  control  actions,  v/hich  one  has  priority. 
This  requires  him  to  set  up  a  priority  rule  of  control  in  each  "state"  of 
the  system,  or  each  of  the  combinations  of  the  possible  perform.ance  levels 
of  the  activities.   His  objective  is  the  maximization  of  the  sum  of  the 
average  net  utilities  produced  per  day  by  the  individual  activities,  the 
values  of  individual  production  less  the  costs  of  control  actions 
representing  the  only  type  of  cost  considered  in  the  analysis.   Solutions 
to  optimal  strategies  for  control  are  obtained  bj''  using  the  method  of 
linear  programming  for  sequential  decisions  proposed  by  A,  S.  Kanne  [7], 


under  tlie  assumption  of  a  Harkovian  steady  state  foi''  the  operation  of 
the  system.  Wagner  [9]  pi'^oved  the  existence  of  an  optimal  solution  liaving 
onlj'  pure  strategies  in  this  method. 

The  steady  state  is  derived  from  the  stationari"-  transition  probabilities 
that  have  been  assumed  for  the  performance  deterioration  and  improvement 
of  activities.   Althougli  in  theory  the  steady  state  distribution  can  be 
reached  from  any  initial  distribution  after  an  infinite  number  of 
transitions,  in  reality  an  ergodic  chain  produces  em  approximately 
constant  distribution,  a  steady  state  in  the  sense  of  pi-'actical  use,  in 
a  finite  number  of  transitions  and  often  in  onJ.y  several  transitions. 
Manne  indicated  the  omission  of  initial  conditions  and  time  discounting 
as  shortcomings  of  his  method.   The  omission  of  initial  conditions  for 
Markov  process  may  significantly  affect  the  selection  of  optimal  strategies; 
specifically,  if  the  optimal  matrix  in  the  linear  programming  solution  is 
a  "decomposable"  one,  the  initial  conditions  vjill  clearly  govern  tlie 
ultimate  statistical  equilibi-'ium  [7,  p.  26U],   Later,  D'Epenoux  [8]  and 
de  Ghellinck  and  Eppen  [3]  proposed  linear  programming  methods  that  take 
into  consideration  both  the  initial  conditions  and  tim.e  discounting. 

Derman  [U]  and  Klein  [6]  discussed  problems  related  to  the  control  of 
a  deteriorating  system  with  the  assumption  that  the  time  between  successive 
transitions  depended  on  the  control  decision.   They  achieved  the  minimiza- 
tion of  the  average  cost  per  unit  time  represented  by  an  objective  function 
in  fractional  form  through  the  transformation  of  the  original  formulation 
to  the  linear  programming  formulation  of  Hanne.   Using  their  method  we 
transform,  our  original  formulation  v-zith  a  fractional  objective  function 
to  a  linear  programming  formulation. 


II.   Discussion 

The  organization  being  studied  here  is  composed  of  a  menager  and  a 
system  of  two  independent,  dissimilar  activities.  Activity  I  and  Activity 
II.   At  the  end  of  n  day  the  manager  collects  information  regarding  the 
conditions  of  the   activities  during  the  day  and,  on  the  basis  of  this 
inf orr.ation ,  determines  v;hether  Activity  I  or  Activity  II  should  be  given 
a  control  action. 
1.   Ferfoi-'mance  Levels,  Deterioration,  and  Improvement 

The  condition  of  each  activitj'  at  the  end  of  the  day  is  described  by 

one  of  a  finite  number  of  performance  levels,  L, ,  ...,  L  for  Activity  I 

'   1'     '   m 

and  Lv ,  ...»  L-'-'...  for  Activity  II.   (VJhenever  a  pair  of  identical  symbols 
1'    '  m-  J  t  J 

is  used,  a  symbol  v:ithout  '•■   pertains  to  Activity  I  and  a  symbol  with  "  to 
Activity  II.  ) 

The  utilities  produced  at  these  levels  are  v  ,  ...,  v  for  Activity  I 
and  V-'-,  ...,  V"...  for  Activity  II  and  given  by  vectors  V  and  V",  respectively. 


(1) 


V  = 


m-' 


The  utilities  v;ithin  each  set  have  no  identical  values  and  can  be 
ordered  by  preference  as  follows: 


(2)     v_  >  ...  >  v  >  0, 
1         m  =   ' 


Vv  >  . . .  >  V"...  >  0 

1  m-  - 


If  the  utility  produced  at  the  lov;est  level  v  or  v-.,.  equals  zero, 
this  level  represents  the  condition  of  breakdown,  thereby  producing  no 
utility. 


Natural  deteriorati.on  of  the  perforraance   level  of  each  activity   is   a 

Markov  process  in  v,'hich  the  activity  daily  moves  from  one  level  to  other 

levels  v.'ith  given  probabilities  that  stay  stationary  over  time.   These 

transition  probabilities  for  Activity  I  are  represented  by  p .   v/ith  i  being 

the  level  on  the  preceding  day  and  h  the  level  on  the  follov/ing  day; 

similarly,  pv  ,  denotes  these  probabilities  for  Activity  II,   (Symbols 

with  doiible  subscripts  separated  by  a  comma,  svich  as  p.   ,  are  used  v.'hen 

the  event  shovm  by  the  second  subscript  is  conditional  to  the  event  shown 

by  the  first  subscript.   On  the  other  hand,  double  subscripts  without  a 

comma,  as  viith  X. .  or  d. .  to  be  introduced  later,  denote  both  events  occur 
•'-D     -'-D 

simultaneously.)  Probabilities  p.  ,  and  pv  ,  are  given  as  elements  of 

i»"  ]  »'^ 

vector  p.    and  pv,   respectively, 

(3)  p.    =    (p.    T,    ....   p-      )  i=ls,..sm 


Pi   =    ^Pi.l Pi. 


-  ft  *    •   «    1 1 

m  '         * 


where 

Pi,h   I  0'  ll.l  Pi.h  =  1 

Similarl}',  we  have 

(H)  p-^   =    (pv^3^,    ....   Pj^m-'-'^  ^""-^ ^" 

where 

■pj.k  I  °'   dp=^j,k  =  1 

The  assumption  that  the  performance  of  an  activity  does  not  improve  v;ithout 


a  control  action  means  that  p.  ,  (h-1, . . .  ,1-1)  and  pv  ,  (k=l, . . .  ,  j~l) 
are  all  zeros. 

The  length  of  time  required  for  completing  a  control  action  depends 
on  the  activity  and  its  current  performance  level.   The  result  of  the 
control  action  also  is  a  Markov  process  in  which  tlie  transition  of  the 
activit}^  moves  from  one  level  to  improved  levels  is  given  by  a  set  of 
stationary  probabilities.   Let  q .  ,  be  the  probability  v;ith  v;hich  the 
performance  of  Activity  I  improves  from  level  L.  to  level  L.  because  of 
a  control  action;  likewise,  let  C':  ,  be  this  probability  for  Activity  II, 
These  transition  probabilities  are  given  by  vectors  q.  and  qv. 

(5)        q.  =  (qi,i.....qi^„)       i=i "> 

where 


^i.h^°'    4=1  ^i,h 
Similarly,  we  have 


(6) 


where 


iv  -  ( qv  ,  , . . .  ^qV   .•. )     j  =1 , . .  . 


^j,k  '=   °'    ^k=l  ^j,k  =   1 

If  a  control  action  never  lowers  the  performance  of  an  activity, 

q.  ,  (h=i+l m)  end  qv  ,  (k  =  j  +  1,. , ,  ,m")  are  all  zeros.   Further,  if 

1 ,n  ]  ,K 

q.  .  >  0  or  qv  .  >  0 ,  the  control  action  executed  at  L.  or  L";  may  fail 
to  improve  the  performance  of  the  activity.   This  implies  that  the  time 


required  for  improving  the  performance  to  a  higher  level  is  uncertain, 
although  a  constant  time  is  required  for  executing  a  control  action. 
2.   States  and  Expected  Utilities 

Clearly,  the  performance  levels  of  the  two  activities  during  the  day 
determine  the  next  course  of  action  to  be  selected  by  the  managex^'.   Since 
there  are  m  possible  levels  for  Activity  I  and  m"-'-  possible  levels  for 
Activity  11,  there  are  mm"  possible  combinations  of  the  levels  of  these 
activities.   We  name  each  of  the  combinations  a  "state"  of  the  system  and 
denote  it  by  S. .  where  i  represents  the  level  for  Activity  I  and  j  the 
level  for  Activity  II.   In  each  state  the  manager  may  take  a  particular 
course  of  action,  z,  from  the  set  Z  of  alternative  courses  of  action: 

zeZ  =  {0,  1,  2} 

where 

z  =  0:  To  take  no  control  action  on  either  activity. 

(7)  z  =  1:  To  take  an  action  on  Activity  I  but  not  on  Activity  II. 

z  =  2:  To  tdike  an  action  on  Activity  II  but  not  on  Activity  I. 

Both  activities  are  engaged  in  production  of  independent  items  and 
the  group  utility  is  the  sum  of  their  net  utilities,  the  utilities  produced 
less  the  costs  of  control.   It  takes  one  day  for  the  manager  to  collect 
information  regarding  the  perfoi^mance  of  each  activity.   Let  r.  and  c.  be 
the  number  of  days  and  the  cost  required  for  the  execution  of  a  control 
action  on  Activity  I  at  L.;  rv  and  c-'5  be  those  required  for  the  execution 
of  a  control  action  on  Activity  II  at  L-'-;   and  d.  .  be  the  number  of 


days  betvjeen  the  decision  to  take  control  action  z  in  S.  .  and  the  next 

1] 

decision  point.  If  the  manager  is  constantly  engaged  in  either  collecting 
information  or  executing  a  control  action,  d..  is  given  as  f ollov;s : 


(8)    df.  =  I 

ID 


if  z  =  0 


r.-fi   if  z  =  1 

1 

rv+i   if  z  =  2 
3 


An  activity  produces  no  utility  while  it  is  given  a  control  action, 
whereas  the  other-  activity  continues  its  production.   Further,  any 
decision  is  irreversible  and  a  new  decision  cannot  be  made  until  the  time 
set  bjr  the  last  decision.   The  net  utility  expected  of  the  system  during 
the  period  d.".  is  given  by  the  following  W.  .: 


(9) 


W 


.  .  =  p.V  +  pvV-' 
ID   ^1    ^D 


(10) 


r . 
,•.  i> 


W^.  =  {q^V  +  p-Kl+P-t  ...  +P-  )\''-   -  c.} 


(11) 


rv 


VJ   =  {p.(I+P+  ...  +  P  -')V  +  q-iV"-  -  cV}    i  =  l,...,v);    j=^l . . . .  .m-' 


where  P  and  P-'-  are  the  follovring  matrices  composed  of  row  vectors  p.  and 
pv: 


(12) 


P-A-  = 


Pm--^ 


3 .   Formulation  of  a  Linear  Program 

Let  X. .  be  the  state  variable  representing  the  proportion  of  the 

time  in  which  the  course  of  action  z  is  selected  in  state  S.  ..   Then  the 

ID 


following  function  gives  the  avex'&ge   net  utility  per  day  of  the  system 
which  the  manager  v/ants  to  maximize: 

r     Tm        rm''  ,,z        z    ■ 
(13)     F  :^      ^""^     '^''^     ^^   ^^ 
^zeZ  ''1=1  ''■j=l  1]   1] 

subject  to 


(I'O    x^.  1  0  Z  =  {0,  1,  2} 


Further,  since  the  state  variables  are  probability  variables,  they  must 
satisfy  the  follov.'ing  unitary  constraint: 

rm   rm-'" 


^zeZ  ^1=1  ''3=1  13 


In  steady  state,  the  probability  of  getting  into  a  state  is  equal  to  the 
probability  of  getting  out  of  this  state.   This  statistical  equilibr^ium 
exists  for  each  of  mm-  states  S  ,  (h=l,...,m;  k=l,..,,m")  and  is  given  by 

^''^    ^i=Jj=i^Pi,hPj,x^iD'^i.hPj,k   4j  '    P,J,       <^y^^} 

h-l,..,,m;  K=l,...,m" 


where 


(rv+1)         ^^  rv-M 

:>.    ?  =  the  i-h   entry  of  matrix  P  ^ 

i,h 
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pv  ,  =   the   j-k        entry  of  matrix  P 

3  t'^ 


Follov;ing  Derman   [4^   p.    22]   and  Klein   [6,   p.    31],  v;e  now  reformulate 

the   above  non-linear  objective   function    (13)   in   x. .    to  a  linear  function 

z 


in  a  new  variable,  X.".,  defined  as 


z 

X.  . 


(17)    X..    =  "t:-^  zeZ 

i=lj.«.jm;  ^-l,.,,,m"' 

where 


(18)    T  ^   I     J^   X'\    d?.  x^ 


3      13 


2 

Using  X..,  we  rewrite  the  objective  function  (13)  as 


(19)    F  =  I      J?      V'?"^  W^  X^ 

Since   T  is  positive   and  xf.    is  non-neeative ,  v/e  have 


(20)        X^.   ^  0  zeZ 


From  (17)  and  (18),  we  get  the  following  unitary  constraint; 


(21)  I  J"?  ,r^\d^.  x^  =  1 

^zcZ''i=l^]  =  l  13   i-j 


Finally,  (16)  is  transformed  to  the  following  equation  retaining 
the  original  coefficients: 


11 


vO   ,      .-.   -^    1      (rv'rl) 


(22)    ).   ).    {p.   pv  ,  X.  .  +  q.  ,  pv       .,1   ,     -]  .,.   .,2 


ij   M,h 


Equations  (19)- (22)  are  all  linear  functions  in  X.'..   There  are  mm" 

ID 

equations  in  (22)  ^  any  one  of  which  can  be  derived  from  the  rest.   Against 
mm"  states  J  v.'e  have  the  same  number  of  independent  equations  in  (21)  and 
(22),  which  guarantees  pure  strategies  giving  a  positive  value  to  only 
one  of  the  state  variables  related  to  each  state  [9  ^  p«  268].   Vfith  (19)- 
(22),  we  have  completed  the  formulation  of  a  linear  program. 

To  find  an  optimal  solution  of  x. .  to  the  original  problem,  first  we 
obtain  T  from  (15)  and  (17): 


(23)    T  = 


Y    rm  ym'"  „z 
^ZEZ^i^l-^j^l  ij 


With  this  T  and  the  transformation  (17),  we  may  find  an  optimal  value 
of  X.  .  for  the  optimal  X.  .  determined  by  the  above  linear  progi^am. 


12 


III.   Numei'ical  Example 

In  this  example  both  Activity  I  and  Activity  II  have  six  possible 
performance  levels  with  utilities  given  by  the  following  vectors  V  and  V"': 

V  =  (50  m.b      45   40   35   SO)'^,    V-  =    (45   40   35   30   25   20)"^ 

Transition  probabilities  for  performance  deterioration  are  given  by 
matrix  P  and  vector  p .  (i=l5...j6)  for  Activity  I  and  matrix  P"  and 
vector  pv  (j  =  lj.,,,6)  for'  Activity  II. 


P  = 


iP-: 


!Pf 


.94   .03   .02   .01   .00   .00, 

i 
\.  .86   .05   .04   .03   .02' 


\n 


P2 


^•^x^.82   .10   ,05   .03,,p-;.-=lpv-.- I 


X   .79   .15   . 05 ;     n- 
~^.  i     ^4 


\ 


\  .76   .24  i 
\.  1,00 


Pg! 


.97  .02  .01  .00  .00 

\  .94   .03   .02  .01 

\ 

X  .92   .04  .03 

\.  .90  .05 

0  ■'..,  .90 


.00 
.00 
.01 
.04 
.10 
1.00 


Since  L  and  L^'  are  the  poorest  levels,  both  p    and  pp       are  equal  to  1. 
Similarly,  transition  pr-obabilities  for  performance  improvement  ovring 
to  control  actions  are  given  by  matrix  Q  and  vector  q.  (i=l,..,,5)  for 
Activity  I  and  matrix  Q-  end  vector  qv  (j=l,...,6)  for  Activity  II. 


- 

- 

^li 

1.00 

^2   i 

.80 

.20 

^3:  = 

.60 

.30 

.10 

0 

1 

.30 

.40 

.22 

.08      . 

^5! 
^ 

.20 

.30 

.25 

.18      .06 

^5    ^ 

.10 

.22 

.30 

.20      .12 

^1 


'i.oo\ 


q^i   j  .82   .18  \ 


i   I 


N 


.  Q"  =  q? 


rs;     ! 


.68   .22   .10 


0 


^5 


^6! 


,  .50   .28   .14   .08  X 
.34   .32   .18   .13   .03 
.22   .32   .22   .15   .05   .02 
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Since  levels  L  and  Ly  cannot  be  improved,  q    of  Q  and  qy   of  Q-'   are 
both  equal  to  1. 

Costs  of  control  actions  are  given  bj'  the  following  vectors  C  and  C-'-: 

C  =  (20   21   22   23  2H      25)"^,   C-  =    (25   2G   27   28   29   30)"^ 

V/e  assume  the  execution  of  a  control  action  takes  one  day  for  either 
activitj'  at  any  level;   r.  =  rv  =  l-(ij  j=ls..«s&).   Therefore,  the 
numbers  of  days  betv,'een  successive  decision  points  are  given  by 

d°.  =  1,  d-}.  .  d^.  =2 
13       ID    13 

A  computer  run  of  this  program  took  33  seconds  on  an  IBM  709U,  producing 

the  optimal  solution  of  X.  .  listed  in  Table  1.   From  these  X.  .'s.  we  find  T  = 
^  13  13 

1.12U5  and  the  expected  net  utility  F  =  86.4.   From  this  T  and  the 

transformation  (17),  v/e  have  obtained  optimal  values  of  the  original 

z  z        .        . 

variables  x..'s  corresponding  to  the  optimal  X..'s,  as  is  shov.'n  in 

Table  1. 

The  optimal  rules  obtained  above  are  graphically  shovm  in  Figure  1 
indicating  a  particular  course  of  action  the  manager  should  taJce  in 
each  of  the  states.   For  example,  if  the  state  of  the  system  is  S   ,  the 
crosspoint  a  ^  of  the  horizontal  line  dravm  through  L  and  the  vertical 
line  dravm  through  Lj'j  falls  in  Region  III,  instructing  the  manager  to 
take  a  control  action  for  Activity  II. 

V,'e  have  tried  several  computer  runs  and  found  that  once  transition 
probability  matrices  P,  P" ,  Q,  and  Q-  are  fixed,  optimal  strategics  in 
various  states  are  relatively  insensitive  to  changes  in  utilities  given 
by  V  and  V"  or  changes  in  costs  of  control  actions  given  by  C  and  C-'-. 
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Fijjure   1.      Optlraal   Cou-x'ses  of  Action  in  Various   States 
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IV.   Summary 

Management  control  of  a  group  of  independent  dissinilar  activities 
has  been  studied  in  this  article.   This  control  is  presumed  to  be  an 
iterative  pz-'ocess  composed  of  three  steps — daily  observation  of  the 
conditions  of  activities,  determination  of  an  optimal  course  of  action, 
and  execution  of  this  course  of  action. 

The  study  assumes  that  the  performance  of  each  activity  tends  to 
deteriorate,  and  that  the  deter^iorated  performance  can  be  improved  only 
by  a  control  action  applied  to  the  activity  by  the  manager.   One  important 
restriction  imposed  on  the  manager  is  that  he  may  control  only  one 
activity  at  a  time.   This  requires  him  to  determine  which  activity  has 
pr-iority,  should  both  activities  need  control  actions.   Further,  the 
study  assumes  that  the  per-formance  deterioration  and  improvement  from 
one  level  to  other  levels  are  given  by  stationary  probabilities.   The 
assumptions  of  the  stationary  probabilities  imply  that  neither  a  change 
in  the  characteristics  of  the  activity  nor  a  change  in  the  skill  of  the 
manager  is  considered.   These  assumptions  enable  us  to  obtain  a  steady' 
state  solution  for  optimal  control  strategies  by  using  the  method  of 
linear  programming  for  sequential  decisions  proposed  by  Hanne, 

A  numerical  example  has  been  illustrated.   The  results  of  examples 
not  reported  shov;  that,  once  the  transition  probabilities  for  deterioration 
and  improvement  are  fixed,  optima]  strategies  are  relatively  insensitive 
to  changes  in  utilities  or  costs  of  control  in  various  states. 

Although  the  transition  period  used  for  deterioration  matrices  P 
and  P"  is  one  day,  a  longer  period  may  be  feasible  v;hen  the  rate  of 
performance  deterioration  is  slov;.   If  the  period  is  changed  to  tv;o 
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days,  three  days,  etc.,  mati-^ices  P  and  P"  should  be  replaced  by  P 

.2   3      .3 

and  P"  ,  P  and  P"  ,  etc.  ,  accordingly. 

The  organization  studied  her'e  is  of  the  simplest  type  having  only 
two  independent  activities.   Further  the  decision  involves  only  v-;hether 
or  not  activities  should  be  given  conti-'ol  actions  at  given  performance 
levels.   Vi'ith  irsinor  changes  in  its  basic  str'ucture  ^  the  present 
formulation  can  readily  be  extended  to  an  organization  composed  of 
N  activities  and  the  decision  bjr  the  manager  can  be  broadened  to  consider 
alternative  control  actions  available  at  each  level  of  an  activity,  any 
number  of  time  intervals  to  elapse  betv;een  successive  decision  points, 
or  variable  periods  required  between  the  time  of  observing  the  performances 
of  activities  and  the  time  of  making  a  decision.   VJith  such  modifications, 
the  model  formulated  her^e  would  better  approximate  the  process  of 
management  control  in  some  real-world  situations  v;here  the  service  of  a 
common  apparatus  is  essential  for  maintaining  the  operations  of  many 
activities.  Illustrations  of  such  situations  inciuue  cases  where  one 
operator  runs  many  machines,  a  crew  of  mechanics  maintains  a  fleet  of 
cars^snda  comjputer  center  processes  information  required  for  the- 
operations  of  various  plants. 
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